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Abstract. A version of the Dynamical Systems Method (DSM) for solving 
ill-posed nonlinear equations with monotone operators in a Hilbert space is 
studied in this paper. An a posteriori stopping rule, based on a discrepancy- 
type principle is proposed and justified mathematically. The results of two 
numerical experiments are presented. They show that the proposed version 
of DSM is numerically efficient. The numerical experiments consist of solving 
nonlinear integral equations. 



1. Introduction 

In this paper we study a Dynamical Systems Method (DSM) for solving the 
equation 

(1-1) F(u) = f, 

where F is a nonlinear twice Frechet differentiable monotone operator in a real 
Hilbert space H, and equation (jl.ip is assumed solvable. Monotonicity means that 

(1.2) (F(u)-F(v),u-v)>0, Vu,veH. 

Here, (•, •) denotes the inner product in H . It is known (see, e.g., [8]), that the set 
J\f := {u : F(u) = /} is closed and convex if F is monotone and continuous. A 
closed and convex set in a Hilbert space has a unique minimal- norm element. This 
element in TV we denote y, F(y) = /. We assume that 

(1.3) sup p^CtOU^M^JZ), 0<j<2, 

\\u-u \\<R 

where uq £ H is an element of H, R > is arbitrary, and / = F(y) is not known; 
but fa, the noisy data, are known and \\fs — f\\ < S. If F'(u) is not boundedly 
invertible, then solving for u given noisy data f$ is often (but not always) an ill- 
posed problem. When F is a linear bounded operator many methods for a stable 
solution of (jl.ip were proposed (see [l]-[8] and the references therein). However, 
when F is nonlinear then the theory is less complete. 

The DSM for solving equation (jl.ip was extensively studied in [8]-p~5]. In [8] 
the following version of the DSM for solving equation (jl.ip was studied: 

(1.4) its = -(F , {us) + a{t)iy 1 (F{u s ) + a{t)us- fs), u s (0) = u . 

Here F is a monotone operator, and a(t) > is a continuous function, defined for 
all t > 0, strictly monotonically decaying, lim^oo a(t) = 0. These assumptions on 
a(t) hold throughout the paper and are not repeated. Additional assumptions on 
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a(t) will appear later. Convergence of the above DSM was proved in [8] for any 
initial value uo with an a priori choice of stopping time tg, provided that a(t) is 
suitably chosen. 

The theory of monotone operators is presented in many books, e.g., in pQ, [7j, 
[16]. Most of the results of the theory of monotone operators, used in this paper, 
can be found in [8]. In [6] methods for solving nonlinear equations in a finite- 
dimensional space are discussed. 

In this paper we propose and justify a stopping rule based on a discrepancy 
principle (DP) for the DSM (|1.4[) . The main result of this paper is Theorem 13.11 
in which a DP is formulated, the existence of the stopping time t$ is proved, and 
the convergence of the DSM with the proposed DP is justified under some natural 
assumptions apparently for the first time for a wide class of nonlinear equations 
with monotone operators. 

These results are new from the theoretical point of view and very useful prac- 
tically. The auxiliary results in our paper are also new and can be used in other 
problems of numerical analysis. These auxiliary results are formulated in Lemmas 
12.2112.41 12.7[ I2.10) 12.111 and in the remarks. In particular, in Remark 13.31 we em- 
phasize that the trajectory of the solution stays in a ball of a fixed radius R for all 
t > 0. 

In Section 4 the results of two numerical experiments arc presented. In the sec- 
ond experiment we demonstrate numerically that our method for solving equation 
can be used even for a wider class of equations than the basic Theorem 13.11 
guarantees. 

2. Auxiliary results 
Let us consider the following equation: 
(2.1) F{V s , a ) + aV s , a -f B = 0, a> 0, 

where a = const. It is known (see, e.g., [5]) that equation (|2.1|) with monotone 
continuous operator F has a unique solution for any f$ G H. 
Let us recall the following result from Op. #112]: 

Lemma 2.1. Assume that equation (jl.l[) is solvable, y is its minimal-norm solu- 
tion, and assumptions () 1 -2|) and (jl.3p hold. Then 

lim||F 0)O -t/|| = 0, 
where Vo j0 solves (|2.ip with 8 = 0. 

Lemma 2.2. If (|1.2[) holds and F is continuous, then \\Vg M \\ = O(-) as a — ► oo, 
and 

(2-2) lim \\F(V Sia )- f s \\ = \\F(0) - f s \\. 

a—>oo 

Proof. Rewrite (12.11) as 

F(y s , a ) - F(0) + aV s ^ a + F(0) - f s = 0. 

Multiply this equation by V^ a , use inequality {F(Vg ta ) — F(0), Vs. a — 0) > from 
([L~2]) and get: 

a\\Vs, a \\ 2 < (aV s ,a + F(Vs,a)-F(0),Vs, a ) = {fs - F(0),V s ,a) < 11/5-^(0)1111^11- 
Therefore, \\V S , a \\ = O(-). This and the continuity of F imply $TZ$. □ 
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Let a = a(t), < a(t) \ 0, and assume a £ C^OjOo). Then the solution 
V$(t) :— Vs.a(t) of (12. ip is a function of t. From the triangle inequality one gets 

\\F(V S (0)) - M| > ||F(0) - M| - \\F(V S (0)) - F(0)||. 

From Lemma [2~2l it follows that for large a(0) one has 

1 



\\F(V s (0)) - F(0)\\ < A/i||V 5 (0)|| =0 



o(0) 



Therefore, if ||F(0) - M| > CS, then \\F(V s (0j) - Ml > (C - e)<5, where e > is 
sufficiently small, for sufficiently large a(0) > 0. 

Below the words decreasing and increasing mean strictly decreasing and strictly 
increasing. 

Lemma 2.3. Assume ||.F(0) — Ml > 0- < a W \ ®> an d ^ F be monotone. 
Denote 

4>(t) := \\F(V 5 (t)) - f 5 \\, m~\\Vs(t)l 

where Vs(t) solves (|2.ip with a = a(t). Then <fi(t) is decreasing, andif>{t) is increas- 
ing. 

Proof. Since \\F(0) - Ml > 0, it follows that i/j(t) ^0,Vt> 0. Note that <p(t) = 
a(t)\\V 6 (t)\\. One has 

< (F(y s (h)) - FiVsWlVsih) - V s (t 2 )) 

(2.3) = (-a(ii)Vi(ii) + a(t 2 )V s (t 2 ), V s (h) - V s (t 2 )) 

= (o(ti) + a(i 2 ))(^(*i), Vfr(t 2 )) - aC*i)MV*C*x)H 2 - a(t 2 )\\V s (t 2 )\\ 2 . 

Thus, 



(2.4) 



< (a(ti) + o(t2))(V tf (ti), V tf (t 2 )) - o(ti)||K tf (ti)|| 2 - a(i 2 )||y 5 (£ 2 )|| 2 
< (o(ti) + o(t2))||K tf (ti)||||K tf (t 2 )|| - a^OH^^)!! 2 - a(i 2 )||^(£ 2 )|| 2 
= (a(ti)||^(ii)|| - a(t 2 )\\Vs(t 2 )\\)(\\V s (t 2 )\\ - \\Vs{tt)\\) 

= (0(tl)-^(t2))(^(t 2 )-V(*l)). 

If ^(i 2 ) > then (l2~4]l implies <js{t\) > 4>{t 2 ), so 

a(*i)^(*i) > a(t 2 )i>{t 2 ) > a(t 2 )^(h). 

Thus, if ip(t 2 ) > ip(ti), then a(t 2 ) < a(t\) and, therefore, t 2 > ti, because a(t) is 
decreasing. 

Similarly, if ip(t 2 ) < ?/>(ii), then </>(ii) < 4>{t 2 ). This implies a(t 2 ) > a(ii), so 
t 2 < ti- 

If tf)(t 2 ) = ip(ti), then ([231) implies 

||^i)|| 2 < (V*(tl), V tf (t2)) < ||^(*i)llll Wll = WVsih)]] 2 , 

This implies Vsiti) = Vs(t 2 ), and then a(ti) — a(t 2 ). Hence, t\ = t 2 , because a(t) 
is decreasing. 

Therefore, <fi(t) is decreasing and ip(t) is increasing. □ 

Lemma 2.4. Suppose that ||.F(0) — M| > C > 1, and a(0) is sufficiently large. 
Then, there exists a unique t\ > suc/i t/ia£ Hi^V^fi)) — Ml = C5. 
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Proof. The uniqueness of t\ follows from Lemma l2~3l We have F(y) = /, and 
=(F(V S ) + aV s - fs,F(V s ) - f 5 ) 
= \\F(V S ) - M| 2 + a(V s - y, F(V S ) - fs) + a(y, F(V 5 ) - f s ) 
= \\F(Vs) - fs\\ 2 + a(V 5 - y, F(V S ) ~ F(y)) + a(V s -y,f- fs) 

+ a(y,F(V s )- fs) 
>\\F(Vs) - fsf + a(V 5 -y,f-fs)+ a(y, F(V S ) - /,). 
Here the inequality (Vs — y,F(Vs) — F(y)) > was used. Therefore, 
\\F(V S ) - fs\\ 2 < -a(V s -yj- fs) - a(y,F(V s ) - f s ) 
(2-5) < a||Vi - 2/IHI/ - Ml + a||y||||F(^) - fs\\ 

<ad\\Vs-y\\+a\\y\\\\F(Vs)-fs\\. 

On the other hand, we have 

= (F(V S ) - F(y) + aV s + / - V s - y) 
= (F(V S ) - F(y), V 5 ~y)+ a\\V s - y\\ 2 + a(y, V s - y) + (f - f s , V s - y) 
> a\\V 5 -y\\ 2 + a(y, V s - y) + (f - fs, V s -y), 
where the inequality (Vs — y, F(Vs) — F(y)) > was used. Therefore, 
a\\V s -y\\ 2 <a\\ y \\\\Vs-y\\+5\\V s -y\\. 

This implies 

(2.6) o||^-»||<o||y||+*. 

From (12. 5| and ()2.6|) . and an elementary inequality ab < to? + |-, Ve > 0, one gets 

\\F(V S ) - fs\\ 2 <S 2 + a\\y\\S + o||i/||||F(V,) - fs\\ 

(2-7) 1 

< ( 5 2 + a||j / ||^ + e||F(^)-M| 2 + - a 2 || 2/ || 2 , 

where e > is fixed, independent of t, and can be chosen arbitrarily small. Let 
^ooando = a{t) \ 0. Then $Ff} implies limsup t ^ oc (l - e)\\F(V s ) - fs\\ 2 < S 2 . 
This, the continuity of F, the continuity of Vs(t) on [0,oo), and the assumption 
||F(0) - f 5 \\ > CS, where C > 1, imply that equation \\F(V s (t)) - f s \\ = C5 must 
have a solution ti > 0. □ 

Remark 2.5. Let V := V s (t)\ s=0 , so F(V) + a{t)V - f = 0. Let y be the minimal- 
norm solution to F(u) — f . We claim that 

(2.8) \\V S -V\\<-. 

a 

Indeed, from (|2.ip one gets 

F(V 5 ) - F(V) + a(V 5 -V) = f-f 5 . 
Multiply this equality by (V^ — V) and use (|1.2p to obtain 

S\\V S -V\\ > (f-fs,V s -V) 

= (F(V S ) - F(V) + a(Vs - V), V s - V) 
>a\\Vs-V\\ 2 . 

This implies 
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Similarly, from the equation 

F(V) + aV - F(y) = 0, 

one can derive that 

(2-9) ||V|| < ||y||. 

From (|2.8|) and (|2.9|) . one gets the following estimate: 

(2.10) 

Let us recall the following lemma, which is basic in our proofs. 



m <imi + -< iMi + -. 

a a 



Lemma 2.6 ([S], p. 97). Let a(t), @{t), j(t) be continuous nonnegative functions 
on [tq, oo), Tq > is a fixed number. If there exists a function /i := fj,(t), 



fi € C 1 [to, oo), fi(t) > 0, lim fi(t) = oo, 

t — >oo 



such that 
(2.11) 

(2.12) 
(2.13) 



< a(t) < — 



i 



7 



m 

/*(*) 



dt' 



and g(t) > satisfies the inequality 

(2.14) j(t) < - 7 (t) ff (t) + a(t) 5 2 (<)+/3(i), i > r , 

then 



(2.15) 



< ff(t) < — 7— r -> 0, as f 
/i(t) 



If inequalities (|2.1ip - (|2.13p /10/d on an interval [to,T), i/ien <7(i), £/ie solution to 
inequality (12. 14[) . exists on this interval and inequality (|2.15|) ZioZds on [to,T). 

Lemma 2.7. Suppose Mi, Co, and c\ are positive constants and =/= y *E H . Then 
there exist A > and a function a(t) € C [0,oo), < a(t) \ 0, such that the 
following conditions hold: 



(2.16) 
(2.17) 
(2.18) 
(2.19) 

Proof. Take 
(2.20) 



< A, 



WVW 

co A 

a(t) ~ 2a(t) 

\a(t)\ < £(*) 

1 a(t) " 2A 



K*)l 
o(t) 

|d(t)| 



a(t) 



1^(0) < 



a 2 (0) 



»(*) = 



(c + t)» 



0<6<1, c> max (26,1). 
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Note that |d| = —a. We have 

(2.21) M>1 = Vt>0. 
v ; a(t) c + t ~ c ~ 2 

Hence, 

(2.22) l<i_Mi, V f>0. 

2 a(t) 

Take 

Mi 

(2.23) A > ' 



1/71 



Then ([2~TB|) is satisfied. 
Choose d such that 



(2.24) d > max I y c 26 A||F(0) - / 5 ||,46Aci 
From equality (|2.20[) and inequality (|2.24[) one gets 

(2 . 2 5) M = b — <^< -L , Vt>0. 
v ; a 2 (i) ^(c + f) 1 - 6 ~ d ~ 4Aci' 

This and inequality (|2.21|) imply inequality (I2.18P . It follows from inequality (|2.24|) 
that 

d 2 a 2 (0) 



(2-26) \\F(p)-f s \\< 

bus, inequality (|2.19p is s. 
Choose k > 1 such that 



c 2b X A 

Thus, inequality (|2. 19|) is satisfied. 



(2.27) k > max , 1 
Define 

(2.28) v(t) := na(t), X K := kX. 

Note that inequalities ([2~T6)> . (j2~T8)) . (|2~19|) and (|2~2Tj) still hold for a(t) = K*) and 
A = X K . 

Using the inequalities (|2.27j) and c > 1 and the definition (|2.28|) , one obtains 

. , Cn Xk A„ 

(2.29) -f- < — — < 



1-W 
v 



v(i) ~ 4i/(t) ~ 2v{t) 

Thus, one can replace the function a(t) by v(t) — na{t) and A by A = A K to satisfy 
inequalities ^W\)-^J^. □ 

Remark 2.8. In the proof of Lemma 12.71 a(0) and A can be chosen so that 
is uniformly bounded as S — > regardless of the rate of growth of the constant 
Mi = M 1 (R) from formula Q1.3[l when R — ► oo, i.e., regardless of the strength of 
the nonlincarity F(u). 

Indeed, to satisfy (|2.23|) one can choose A = ¥j. To satisfy (|2.24|) one can choose 



(^/^XWfs-Fm^bXc^j < max (^Adl/ - F(0)|| 



l),46Aci , 
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where we have assumed, without loss of generality, that < S < 1. With this choice 

A 



of d and A, the ratio is bounded uniformly with respect to 5 <E (0, 1) and does 
not depend on R. 

Indeed, with the above choice one has ^p- = -4r < 5(1 + V A -1 ) < c, where 



A c^A 

c > is a constant independent of 5, and one can assume that A > 1 without loss 
of generality. 

This remark is used in Remark l3.31 where we prove that the trajectory of ug(t), 
defined by (|3.1|) , stays in a ball B(uo,R) for all < t < t$, where the number tg 
is defined by formula (|3.3j) (see below), and R > is sufficiently large. An upper 
bound on R is given in Remark 13.31 



Remark 2.9. It is easy to choose Uq € H such that 
(2.30) g := \\u - V s (0)\\ < l|F(l " " J4 



o(0) 

Indeed, if, for example, mq = 0, then by Lemmas 12.21 and 12.31 one gets 



.9o = II ^ (0)|| = — - < 



a(0) - o(0) 

If (I2~19l) and (l2~30l) hold, then g Q < sM. Inequality (l2~30l) also holds if ||« - V^(0)|| 
is sufficiently small. 

Lemma 2.10. Let p,b and c be positive constants. Then 
/ b\ /"* e ps e pt 



Proof. One has 



pt \ pe pt be pt 



Therefore, 



dt\(c + t) b J {c + tf {c + t) b + l 
( b\ e pt 

> \ P- ~ 7 wT, t > 0. 



b\ f* e ps , f* d e ps , 

-)./, J^ ds -l dSJcTs^" 3 

e pt 1 e pt 
~ {c + t) b ~ ~3> ~ {c + t) b 



Lemma T2.10I is proved. □ 
Lemma 2.11. Let a(t) = ^ t sb where d,c,b > 0, c > 6b. One has 

(2.32) e~? j ei\a{s)\\\V s {s)\\ds < \a{t)\\V 5 {t)\\, t > 0. 
Proof. Let p = \ in Lemma 12.101 Then 

(2.33) (\- h -\ I 7 62 s h ds < , 62 , Vc, b > 0. 
1 ' \2 c) J Q (s + c) b (c + t) b ' 
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Since c > 66 or — < h, one has 

1 b 2b 2b 

77 - - > — > , S > 0. 

2 c c c + s 

This implies 

2.34) a(s) [--- = 7 777 77-- > 7 777-7 = 2 d(s), S > 0. 

v ; W V 2 C J (c + s) b \2 cj-(c + s) b + 1 1 w " 

Multiplying (|2.34|) by e^||V^(s)||, integrating from to t, using inequality (|2.33|) 
and the fact that ||Va(s)|| is nondecreasing, one gets 

e*a(t)\\V s (t)\\> J e%\\V s (t)\\a(s)(~-^ds>2^ e* |d( a )|||V^(s)||ds, t > 0. 
This implies inequality (|2.32|) . Lemma [2.111 is proved. □ 

3. Main result 

Denote 

A := F'(ug(t)), A a :=A + aI, 
where / is the identity operator, and us(t) solves the following Cauchy problem: 

(3.1) ug = -A~^[F(u s ) + a(t)ug - fg], Ug(0)=u . 

We assume below that ||F(iio) — fs\\ > Ci<5^, where C\ > 1 and £ G (0, 1] are some 
constants. We also assume, without loss of generality, that 6 G (0, 1). 

Assume that equation F(u) = f has a solution, possibly nonunique, and y is 
the minimal norm solution to this equation. Let / be unknown, but fg be given, 

ii/*-/ii<*- 

Theorem 3.1. Assume a(t) — j^^jf, where b G (0,1], c, d > are constants, 
c > 66, and d is sufficiently large so that conditions (I2.17[) - (|2.19p hold. As- 
sume that F : H — > H is a monotone operator, twice Frechet differentiable, 
sup» e B(„ ,R) \\F {3) (u)\\ < M,(u ,R), 0<j<2, B(u ,R) := {u : ||«-«o|| < R}, 
uo is an element of H , satisfying inequality (|2.30[) and 

(3.2) \\F(u )+a(0)u -fs\\ < \a(0)\\V s (0)\\, 

where Vs(t) := Vs ta (t) solves (|2.ip wrai/i a = a(t). Then the solution ug(t) to problem 
(|3.ip exists on an interval [0, Tj], lim^o Tg = oo, and there exists a unique tg, 
tg G (0,Tg) such that lim^o tg — oo and 

(3.3) \\F(ug(t 5 )) - M| - Citf c , \\F(u s (t)) - / a || > C 1( 5 C , Vt G [0,t 5 ), 
where C\ > 1 cme? < £ < 1. //£ G (0, 1) and tg satisfies (|3.3|l . i/ien 

(3.4) Urn ||««(t«) - = 0. 

o — >0 

Remark 3.2. One can choose uq satisfying inequalities (|2.30[) and (|3.2p (see also 
(I3.34p below). Indeed, if uq is a sufficiently close approximation to Vg(0), the 
solution to equation (|2.ip . then inequalities (|2.30p and (|3.2p are satisfied. Note that 
inequality (|3.2p is a sufficient condition for (|3.35p to hold. In our proof inequality 
(|3.35p is used at t — tg. The stopping time tg is often sufficiently large for the 
quantity e~^~ho to be small. In this case inequality (|3.35p with t = tg is satisfied 
for a wide range of uq. For example, in our numerical experiment in Section 4 the 
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method converged rapidly when uq — 0. Condition c > 66 is used in the proof of 
Lemma 12.111 



Proof of Theorem \3.1\ Denote 

(3.5) C:=^±l. 
Let 

w := u s - Vs, g(t) := \\w\\. 

One has 

(3.6) w = -V s - A~l t) [F(u s ) - F(V S ) + a(t)w] . 
We use Taylor's formula and get 

(3.7) F{u s ) - F{V S ) + aw = A a w + K, \\K\\ < ^\\w\\\ 

where K :— F(u$) — F(Vg) — Aw, and M2 is the constant from the estimate (| 1 . 3|) . 
Multiplying (|3.6[) by w and using (|3.7|) one gets 

(3-8) 99<-g 2 + ^\\A-t t) \\g 3 + \\V s \\g. 

Let to be such that 

(3-9) * = * || y ||, Ol. 

a[to) C - 1 

This to exists and is unique since a(t) > monotonically decays to as t — > 00. 
Since a(t) > monotonically decays, one has 

(3.10) ^^iW- 0m*o- 



By Lemma [23I there exists t\ such that 

(3.11) \\F{V s {ti))-fs\\=CS, F{V 5 {t 1 ))+a{t l )V s {t 1 )-fs = G. 

We claim that t\ G [0, to]- 

Indeed, from (|2~Tj) and (j2~T0|) one gets 

CS = a(ti)\\V s (ti)\\ < o(ti) (\\y\\ + -^A = a(h)\\y\\ +5, C> 1, 

so 

5< «(*x)||2/|| 



(7-1 
Thus, 

s < \\y\\ 



a(ti) ~ C- 1 a(t ) 
Since a(t) \ 0, one has t\ <to- 

Differentiating both sides of (|2.1[) with respect to t, one obtains 

A a (t)Vs = -aVg. 

This implies 

||V5||<HlK ( 1 t) y 5 ||<^||^||<Mf|| y || + -) 

(3.12) I, / 1 \ 
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Since g > 0, inequalities ()3.8|) and (|3.12|) imply 

(3.13) g<-g(t) + ^-g* + ^-C U c = ^, n=||//||(l 



a{ty a(t) " u 2 ' 1 " a " v C-l 
Here we have used the estimate 

11^11 < - 
a 

and the relations 

A a := F'(u) + al, F'(u) := A > 0. 
Inequality (|3~T3)) is of the type (flTTi]) with 

7 (t) = l, «(*) = -£v ^(*) = c iJt- 
a(i) a(i) 

Let us check assumptions (I2.11j) - (|2.13[) . Take 

where A = const > and satisfies conditions (]2.11[) — (|2 . 13[) in Lemma [2771 Since uq 
satisfies inequality (|2.30[) . one gets 17(0) < ^p-, by Remark 12.91 This, inequalities 
(j2~TT|) - (|2~T3j) . and Lemma [2U yield 

(3.14) 9(t)<^f-, Vt<t 0) g(t):=\\u s (t)-V s (t)\\. 

Therefore, 

\\F(u 5 (t)) - f s \\ <\\F(u s (t)) - F(y s (t))\\ + \\F(V s (t)) - f s \\ 
(315) <M ig (t) + \\F(V s (t))-f 5 \\ 

<Ml^l + \\ F (y s (t))-f s \\, Vt<t . 

It is proved in Section [H Lemma 12. 3[ that ||.F(T^(£)) — fs\\ is decreasing. Since 
ti < t , one gets 

(3.16) ll*W*o)) - Ml < \\F(Ys(ti)) - Ml = cs. 

This, inequality ([5715]) . the inequality ^ < \\y\\ (see (gTJ5)) ), the relation (|33)) . and 
the definition Ci = 2C — 1 (see (|3.5p ). imply 

l|F(« f (<o))- All <^^+Ci 
A||y|| 

Thus, if 

11^5(0)) - M| > CkF, 0< 7 <1, 
then, by the continuity of the function t — ► Iji^M^i)) — /^|| on [0, 00), there exists 
i<5 6 (0, to) such that 

(3.18) \\F(u 5 (t s )) - f s \\ =Ci<T 

for any given 7 G (0, 1], and any fixed C\ > 1. 
Lei ms prove (|3.4|) . 
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From (|3.15|) with t = ts, and from ()2.10p . one gets 

CW C <M 1 ^- + a(t s )\\Vs(t 5 )\\ 

<M 1 ^- + \\y\\a(t s )+S. 
Thus, for sufhciently small 5, one gets 

C^<a(t s )(^ + \\yij, C>0, 
where C < C\ is a constant. Therefore, 

(3.19) lim -4-r < lim f ^ + ||y||^ = 0, < C < 1- 

We claim that 

(3.20) lim< A - = oo. 

<5^0 

Let us prove (|3.20p . Using (|3.ip . one obtains 

^(F(u 5 ) + auj - / 5 ) = ^4 a ?i 5 + au s = -(F(u s ) + aug - fs) + au s . 
This and (|2~Tj) imply 

(3.21) -| [F(u 5 ) ~ F(V S ) + a{u s - V s )] = - [F(u s ) - F{V S ) + a{u s - V s )] + au s . 
Denote 

v := v(t) := F(u 5 (t)) - F{V s (t)) + a(t)(u s {t) - V 5 (t)), h := h{t) := ||v||. 
Multiplying (|3.2ip by v, one obtains 

hh = -h 2 + (v, a(us - Vs)) + a{v, Vs) 

< -h 2 + h\a\\\u s - V s \\ + \a\h\\V s \\, h>0. 
Thus, 

(3.23) h<-h+\a\\\us-Vs\\ + \a\\\Vs\\. 

Since (F(us) — F(Vs), us — Vs) > 0, one obtains from the two equations 
(v, us - Vs) = (F{u s ) - F{V S ) + a(t)(u s - V s ),u g - V s ) 

and 

(v,F(us) - F{V 5 )) = \\F(u s ) - F{V S )\\ 2 + a{t)(u s - V Sl F(us) - F(V S )), 
the following two inequalities: 

(3.24) a\\u s -Vs\\ 2 < (v,u s -V s ) < \\u s - V 5 \\h 
and 

(3.25) \\F(us)-F(Vs)\\ 2 <(v,F(u s )~F(Vs)) <h\\F(u s )-F(V s )\\. 
Inequalities (|3.24|) and (|3.25p imply 

(3.26) a\\u s -Vs\\<h, \\F(u 5 ) - F(V S )\\ < h. 



(3-22) 
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Inequalities (I3.23|) and (|3.26p imply 

(3.27) h<-h(l-^j+\a\\\V s \\. 

Since 1 — ^ > | because c > 26, inequality (]3.27[) holds if 
(3.28) 

Inequality (|3.28[) implies 

(3.29) h(t) < h(Q)e-i + e~i [ e%\a\\\V s \\ds. 

Jo 

From (|3~29|) and ([3T26]) . one gets 

(3.30) \\F(u s (t))-F(V 5 (t))\\<h(0)e-i +e-i [ e 4|d|||F 5 ||rfs. 
Therefore, 



\\F(u s (t)) - f 5 \\ > \\F(V s (t)) - M| - \\F(V 6 (t)) - F(u s (t))\\ 

(3 31) 

>o(i)||Vi(t)||-M0)e~*-e-' / e*|d|||V&||ds. 

Jo 

From the results in Section [5] (see Lemma fe.llj) . it follows that there exists an a(t) 
such that 

(3-32) ±a(t)\\V 5 (t)\\>e-i j\i\a\\\Vs(s)\\ds. 

For example, one can choose 

d 

{cTtf 

where d,c,b> 0. Moreover, one can always choose uq such that 
(3.34) h(0) = \\F(u o )+a(0)u o - fs\\ < ^a(0)\\V 5 (0)\\, 

because the equation F(uq) + a(0)uo — ,fs = is solvable. If (I3.34|) holds, then 
h(0)e~i 

If 26 < c, then (pH3"j) implies 



(3.33) a{t ) = 7 -—, 66 < 



h(0)e~i < ia(0)||V5(0)||e-4, t > 0. 



e-2 fl (0) < a (t). 

Therefore, 

(3.35) e-U(O) < ja(i)||^(0)|| < io(*)||Vj(t)||, t > 0, 

where we have used the inequality ||V5(i)|| < ||Vj(i')|| f° r * < established in 
Lemma [23] in Section [2] From (jXTH)) and (|3~3T|) - ([335l) . one gets 

C l ^ = \\F(u B (t s ))-f s \\ > \a(t s )\\V s (ts)\\. 



Thus, 



lim a(t s )\\Vs(ts)\\ < lim4C 1( 5 c = 0. 

(5^0 5^0 
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Since ||Va(i)|| increases (see Lemma |2.3|) . the above formula implies lim^o a(ts) = 
0. Since < a(t) \ 0, it follows that lim^o ts = oo, i.e., (|3.20|) holds. 
It is now easy to finish the proof of the Theorem 13.11 
From the triangle inequality and inequalities (|3.14|) and (12. 8[) one obtains 

\\us(ts) - y\\ < \\u s (ts) - Vs(ts)\\ + \\V(t s ) - Vs(t 5 )\\ + \\V(t s ) - y\\ 
A a(tg) 

Note that V(t s ) = V 0>a (t s ) (see equation PTIjl). From J33S]), (|3~2"u]l . inequality 
(|3.36p and Lemma [231 one obtains (|3.4|) . Theorem 13. II is proved. □ 

Remark 3.3. The trajectory Ug(i) remains in the ball B(uq, R) :— {u : \\u — uq|| < 
R} for all t<tg, where R does not depend on S as 6 — > 0. Indeed, estimates (|3.14l) . 
pTUf and (jOu) imply 

IM*) - Moll < ||«j(t) ~ V s (t)\\ + \\V s (t)\\ + \\u \\ 

(3 - 37) <a (0) C\\y\\ 

< — ^- + c _ 1 + IKH := it, Mt<t s . 

Here we have used the fact that fa < io (see the proof of Theorem 13. ip . Since one 
can choose a(t) and A so that ^p- is uniformly bounded as S — > and regardless of 
the growth of Mi (see Remark l2.8|) one concludes that R can be chosen independent 
of 5 and Mi . 

4. Numerical experiments 

4.1. An experiment with an operator defined on H = L 2 [Q, 1]. Let us do a 

numerical experiment solving nonlinear equation (11. ip with 

(4.1) F(u) := B(u) + (arctan(u)) 3 := / e^ x ' yl u(y)dy + ( arctan(w)) 3 . 

Since the function u — > arctan 3 u is increasing on R, one has 

(4.2) (( arctan(u)) 3 — ( arctan(w)) 3 , u — v) > 0, Vu, v £ H. 
Moreover, 

(4.3) e-l*l = - / —rjdX. 
Therefore, (i?(w — v), it — v) > 0, so 

(4.4) - - u) > 0, Vu,veH. 
Thus, F is a monotone operator. Note that 

(( arctan(it)) 3 — ( arctan(u)) 3 , u — v) = iff u = v a.e. 

Therefore, the operator F, defined in (|4.ip , is injective and equation (|l.ip . with 
this .F, has at most one solution. 
The Frechet derivative of F is 

(4.5) F'(u)w = 3 ( aictan ^) w+ f e-l^-^lwfy)^. 

1 + u 2 Jo 
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If u(x) vanishes on a set of positive Lebesgue measure, then F'(u) is not boundedly 
invertible. If u € C[0, 1] vanishes even at one point xo, then F'(u) is not boundedly 
invertible in H . 

In numerical implementation of the DSM, one often discretizes the Cauchy prob- 
lem (|3.1I) and gets a system of ordinary differential equations (ODEs). Then, one 
can use numerical methods for solving ODEs to solve the system of ordinary differ- 
ential equations obtained from discretization. There are many numerical methods 
for solving ODEs (see, e.g., [2])- 

In practice one does not have to compute us{ts) exactly but can use an ap- 
proximation to ug(ts) as a stable solution to equation (jl.ip . To calculate such an 
approximation, one can use, for example, the iterative scheme 

„, Un+i = u n - (F'(u n ) + a n J) _1 (F(u„) + a n u n - f s ), 

(4-6) 

u = 0, 

and stop iterations at n :— ns such that the following inequality holds: 
(4.7) 

\\F(u ns ) - f s \\ < C5\ \\F{u n ) - f s \\ > C5\ n<n s , C > 1, 7 £ (0, 1). 

The existence of the stopping time ns is proved in [51 p. 733] and the choice uq = 
is also justified in this paper. Iterative scheme (|4.6[) and stopping rule (|4.7p are 
used in the numerical experiments. We proved in [3j p. 733] that u ng converges to 
u*, a solution of (|I .ip . Since F is injective as discussed above, we conclude that u n/j 
converges to the unique solution of equation (II. ip as 5 tends to 0. The accuracy and 
stability are the key issues in solving the Cauchy problem. The iterative scheme 
(|4.6p can be considered formally as the explicit Euler's method with the stepsize 
h = 1 (see, e.g., [2]). There might be other iterative schemes which are more 
efficient than scheme (|4.6p . but this scheme is simple and easy to implement. 

Integrals of the form J e~\ x ~ y \fi(y)dy in (|4.ip and (|4.5p are computed by using 
the trapezoidal rule. The noisy function used in the test is 

fs(x) = f(x) + Kf noise (x), k > 0. 

The noise level 5 and the relative noise level are defined by the formulas 

5 = «||/noi S e||, ^:= M - 

In the test k is computed in such a way that the relative noise level S re i equals some 
desired value, i.e., 

k _ $ SrelWfW 
1 1 f noise \ \ \\ f noise \\ 

We have used the relative noise level as an input parameter in the test. 

In all the figures the x- variable runs through the interval [0, 1], and the graphs 
represent the numerical solutions uusm(x) and the exact solution u exact {x). 

In the test we took h = 1, C = 1.01, and 7 = 0.99. The exact solution in the 
test is 

'0 if \ < x < 2 
otherwise, 



(4.8) u e { x ) = r 1 ■ ' 



here x <G [0, 1], and the right-hand side is / = F(u e ). As mentioned above, F'(u) is 
not boundedly invertible in any neighborhood of u e . 
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It is proved in [3] that one can take a n — jt^, and d is sufficiently large. However, 
in practice, if we choose d too large, then the method will use too many iterations 
before reaching the stopping time n$ in (|4.7[) . This means that the computation 
time will be large in this case. Since 

\\F(V s )-fs\\ = a(t)\\Vsl 

and \\Vs(t s ) - u s (ts)\\ = 0{a(t s )), we have 

CP = \\F(u s (t s )) - M| < a{t s )\\Vs\\ + 0(a(t s )), 

and we choose 

d = Cod' 1 , Co > 0. 
In the experiments our method works well with Cq £ [7, 10]. In numerical experi- 
ments, we found out that the method diverged for smaller Co- In the test we chose 

rO-99 

a n by the formula a n :— Co^rf- The number of nodal points, used in computing 
integrals in (|4.1[) and (|4.5[) . was N = 100. The accuracy of the solutions obtained 
in the tests with N — 30 and N — 50 was slightly less accurate than the one for 
N = 100. 

Numerical results for various values of S re i are presented in Table [TJ In this 
experiment, the noise function f noise is a vector with random entries normally 
distributed, with mean value and variance 1. Table [T] shows that the iterative 
scheme yields good numerical results. 

Table 1. Results when C = 7 ', N = 100 and u = u e . 



Srel 


0.02 


0.01 


0.005 


0.003 


0.001 


Number of iterations 


57 


57 


58 


58 


59 


\\UDSM —V-exact || 
lltteasct II 


0.1437 


0.1217 


0.0829 


0.0746 


0.0544 



Figure [T] presents the numerical results when N = 100 and Co = 7 with 5 re i = 
0.01 and S re i = 0.005. The numbers of iterations for S = 0.01 and S = 0.005 were 
57 and 58, respectively. 

FigureOpresents the numerical results when N — 100 and Co — 7 with S — 0.003 
and S = 0.001. In these cases, it took 58 and 59 iterations to get the numerical 
solutions for S re i = 0.003 and 8 re i = 0.001, respectively. 

We also carried out numerical experiments with u(x) = 1, x S [0, 1], as the exact 
solution. Note that F'(u) is boundedly invertible at this exact solution. However, in 
any arbitrarily small (in L 2 norm) neighborhood of this solution, there are infinitely 
many elements u at which F'(u) is not boundedly invertible, because, as we have 
pointed out earlier, F'(u) is not boundedly invertible if u(x) is continuous and 
vanishes at some point x € [0,1]. In this case one cannot use the usual methods 
like Newton's method or the Newton-Kantorovich method. Numerical results for 
this experiment are presented in Table [2 

Table 2. Results when C = 4, N = 50 and u(x) = 1, x G [0, 1]. 



Srel 


0.05 


0.03 


0.02 


0.01 


0.003 


0.001 


Number of iterations 


28 


29 


28 


29 


29 


29 


\\ U DSM —u eJ:ac t | 
1 «• xact II 


0.0770 


0.0411 


0.0314 


0.0146 


0.0046 


0.0015 



From Table [5] one concludes that the method works well in this experiment. 
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8 ,=0.01, N=100 
rel 



1.4 

1.2 
1 

0.8 
0.6 
0.4 
0.2 



-0.2 



exact 
U DSM 




0.2 0.4 0.6 

x 



8 =0.005, N=100 
rel 



1.4 
1.2 

1 

0.8 
0.6 
0.4 
0.2 



-0.2 



0.2 



0.4 0.6 
x 



0.8 1 



Figure 1. Plots solutions obtained by the DSM when N = 100, 
5 re i = 0.01 (left) and 5 re i = 0.005 (right). 



8 =0.003, N=100 
rel 



8 =0.001, N=100 

rel 




1.4 

1.2 
1 

0.8 
0.6 
0.4 
0.2 


-0.2 



exact 
U DSM 



0.2 0.4 0.6 O.f 

x 



Figure 2. Plots solutions obtained by the DSM when N = 100, 
5 re i = 0.003 (left) and S re i = 0.001 (right). 



4.2. An experiment with an operator defined on a dense subset of H = 

L 2 [0, 1]. Our second numerical experiment with the equation F(u) = / deals with 
the operator F which is not defined on all of H = L 2 [0, 1], but on a dense subset 
D = C[0, 1] of H: 

(4.9) F{u) := B(u) + u 3 := [ e^ x -^u(y)dy + u 3 . 

Jo 

Therefore, the assumptions of Theorem l3.1l are not satisfied. Our goal is to show by 
this numerical example, that numerically our method may work for an even wider 
class of problems than that covered by Theorem 13. II 
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The operator B is compact in H = L 2 [0, 1]. The operator u i — ► u 3 is defined on 
a dense subset D of L 2 [0, 1], for example, on D := C[0, 1]. If u,w G D, then 

(4.10) (u 3 -v 3 ,u-v) = [ {u 3 -v 3 )(u- v)dx > 0. 

./o 

This and the inequality (-B(w — v), u — v) > 0, followed from equality (|4.3|) . imply 

u) > 0, Mu, v e D. 

Note that the equal sign of inequality (|4. 10[) happens iff u = v a.e. in Lebesgue 
measure. Thus, F is injective. Therefore, the element u ns obtained from the 
iterative scheme (|4.6[) and the stopping rule (|4.7[) converges to the exact solution 
u e as (5 goes to 0. 

Note that D does not contain subsets open in H = L 2 [0, 1], i.e., it does not 
contain interior points of H . This is a reflection of the fact that the operator 
G{u) — u 3 is unbounded on any open subset of H. For example, in any ball 
IMI < C, C = const > 0, where \\u\\ := ||u||l 2 [o,i] j there is an element u such 
that ||m 3 || = oo. As such an element one can take, for example, u{x) = c\x~ h ', 
| < b < |. Here c\ > is a constant chosen so that ||u|| < C. The operator 
u i — > -F(u) = G(m) + -B(m) is maximal monotone on Z?i? := {u : u E H, F(u) € H} 
(see [TJ p. #102]), so that equation ()2.ip is uniquely solvable for any fs G -ff. 

The Frechet derivative of F is 

(4.11) F'(u)w = 3u 2 w+ [ e^ x ^w{y)dy. 

Jo 

If u(x) vanishes on a set of positive Lebesgue measure, then F'(u) is obviously not 
boundedly invertible. If u G C[0, 1] vanishes even at one point Xq, then F'(u) is 
not boundedly invertible in H. 

We also use the iterative scheme (|4.6p with the stopping rule (|4.7[) . 

We use the same exact solution u e as in (|4.8p . The right-hand side / is computed 
by / = F(u e ). Note that F' is not boundedly invertible in any neighborhood of u e . 

In experiments wc found that our method works well with Co G [1,4]. Indeed, in 
the test we chose a n by the formula a n := Co^pg- The number of node points used 
in computing integrals in (|4.1|1 and (|4.5|) was N = 30. In the test, the accuracy of 
the solutions obtained when N — 30, N = 50 were slightly less accurate than the 
one when N = 100. 

Numerical results for various values of S re i are presented in Table [3l In this 
experiment, the noise function f no i se is a vector with random entries normally 
distributed of mean and variance 1 . Table [3] shows that the iterative scheme 
yields good numerical results. 

Table 3. Results when C = 2 and N = 100. 



Srel 


0.02 


0.01 


0.005 


0.003 


0.001 


Number of iterations 


16 


17 


17 


17 


18 


ll«DSM -"exact || 
lltteaactll 


0.1387 


0.1281 


0.0966 


0.0784 


0.0626 



Figure [3] presents the numerical results when f n0 ise(x) — sin(37ra;) for 5 re i — 0.02 
and Srel — 0.01. The number of iterations when Co = 2 for S re l — 0.02 and 
Srei — 0.01 were 16 and 17, respectively. 
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Figure 3. Plots solutions obtained by the DSM with f no ise{x) = 
sin(37ra) when N = 100, 5 rei = 0.02 (left) and d rei = 0.01 (right). 



Figure 2] presents the numerical results when f no i se {x) = sin(37rx) with 6 re i = 
0.003 and S re i = 0.001. We also used Co = 2. In these cases, it took 17 and 
18 iterations to give the numerical solutions for 5 re i = 0.003 and 5 re i = 0.001, 
respectively. 



5 ,=0.003, N=100 
rel 



0.2 



0.4 0.6 

X 



0.8 



1.4 
1.2 
1 

0.8 
0.6 
0.4 
0.2 



-0.2 



8 =0.001, N=1 00 
rel 



0.2 



0.4 0.6 
x 



exact 
U DSM 



0.8 



Figure 4. Plots solutions obtained by the DSM with f no i se (x) = 
sin(37re) when N = 100, 6 re i = 0.003 (left) and S re i = 0.001 (right). 

We have included the results of the numerical experiments with u{x) = 1, x S 
[0, 1], as the exact solution. The operator F'(u) is boundedly invertible in L 2 ([Q, 1]) 
at this exact solution. However, in any arbitrarily small L 2 -neighborhood of this 
solution, there are infinitely many elements u at which F'(u) is not boundedly 
invertible as was mentioned above. Therefore, even in this case one cannot use 
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the usual methods such as Newton's method or the Newton-Kantorovich method. 
Numerical results for this experiment are presented in Table |4] 

Table 4. Results when C = 1, N = 30 and u(x) = 1, x S [0, 1]. 



Srel 


0.05 


0.03 


0.02 


0.01 


0.003 


0.001 


Number of iterations 


7 


8 


8 


9 


10 


10 


\\ U L)SM ~ u exact 1 
\\uexact II 


0.0436 


0.0245 


0.0172 


0.0092 


0.0026 


0.0009 



From the numerical experiments we can conclude that the method works well in 
this experiment. Note that the function F used in this experiment is not defined 
on the whole space H — L 2 [0, 1] but defined on a dense subset D = C[0, 1] of H. 
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